Questions tagged [cls token]

lucas_clark_artist Tue Nov 19 2024 | 7 answers 1688

I'm currently studying natural language processing and have encountered the term 'CLS token' frequently. I'm wondering what exactly a CLS token is and its role in this field.

JejuSunshineSoulMateWarmth Tue Nov 19 2024 | 5 answers 909

I'm trying to understand the concept of the CLS token in the context of Vision Transformer (ViT). Could someone explain its purpose and how it fits into the overall architecture?

IncheonBeauty Sun Nov 17 2024 | 5 answers 1119

I'm wondering about the purpose of the CLS token. I've encountered it in some contexts related to natural language processing, but I'm not sure what it's specifically used for.

Isabella Sat Nov 16 2024 | 6 answers 1297

CLS token pooling is a strategy used in Vision Transformer (ViT) models, where a special classification token (CLS token) is added to the input sequence. The output representation of this token is then used for the final classification task, aggregating information from all patches to provide a global feature representation of the image.